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Abstract — We consider a line of terminals which is connected 
by packet erasure channels and where random linear network 
coding is carried out at each node prior to transmission. In 
particular, we address an online approach in which each terminal 
has local information to be conveyed to the base station at the 
end of the line and provide a queueing theoretic analysis of 
this scenario. First, a genie-aided scenario is considered and the 
average delay and average transmission energy depending on 
the link erasure probabilities and the Poisson arrival rates at 
each node are analyzed. We then assume that all nodes cannot 
send and receive at the same time. The transmitting nodes in 
the network send coded data packets before stopping to wait 
for the receiving nodes to acknowledge the number of degrees 
of freedom, if any, that are required to decode correctly the 
information. We analyze this problem for an infinite queue size 
at the terminals and show that there is an optimal number of 
coded data packets at each node, in terms of average completion 
time or transmission energy, to be sent before stopping to listen. 

I. Introduction 

In networks, the transfer of packets from source to destina- 
tion can be in general modeled as a flow of packets |2|. 
Such a flow is typically routed through intermediate nodes 
in which the packets are stored in buffers for subsequent 
transmission. Further, other flows may join existing flows at 
intermediate nodes in order to be routed towards the same 
direction downstream in the network. Of particular interest 
in these scenarios is the average end-to-end delay of packets 
associated with a specific flow. At the same time, in many 
scenarios related to networks with energy-constrained nodes, 
the average completion energy of conveying a packet from 
source to destination is required to be as small as possible. Sat- 
isfying these constraints is particularly challenging in wireless 
networks where the physical links between nodes may become 
unreliable due to noise, interference, and fading due to node 
mobility, which typically leads to packet erasures. 

For such packet-erasure networks, one approach to reliable 
transmission is to employ random linear network coding lO, 
im over stored packets at each node. In the following we 
will model packet flows in networks by simple erasure line 
networks. For such networks, it has been shown in jS), ||6| 
that in-network coding is beneficial compared to a traditional 
end-to-end forward erasure correction approach, and that the 
min-cut capacity can be achieved asymptotically. The expected 
delay for multihop line networks and random linear coding has 
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been characterized in fl], and in IS], ID a queueing- theoretic 
analysis of finite buffer effects has been carried out. 

In this paper we consider packet flows in two-hop erasure 
line networks. As a new result we study the practically impor- 
tant case of multiple flows by assuming that both the first and 
the second node in the line have local information packets with 
Poisson-distributed arrivals available which are demanded by 
the receiver For a related scenario and deterministic channels 
between the nodes the capacity region has been recently 
established in flO]. In our work, we address both online and 
batch-to-batch approaches and provide a queueing-theoretic 
analysis, where average delay and average energy consumption 
as a function of the link erasure probabilities and the arrival 
rates at each node are analyzed. We then assume that all 
terminals cannot send and receive at the same time, which 
is an extension of the results for the point-to-point case 
IIT2II to multihop networks. We show that there is an optimal 
number of coded data packets at each node, for example in 
terms of average completion time or energy, to be sent before 
stopping to listen, and devise an efficient algorithm to find 
these values. Finally, we compare our half-duplex schemes 
with selective repeat (i.e., a scheme with no coding). 

II. Genie- Aided Inter-Session Coding 

Let us assume a line network with three nodes, where two 
adjacent nodes (Si, S2) are source nodes and the final node is 
the destination, R (see Fig. [TJ. Each source S). generates data 
packets at a rate of X/^ via a Poisson process; we assume that 
the packet arrivals at each source are independent from each 
other This defines the following packet flows. Si S2 
R and ^2 — ^ R, where flow k is the flow originating at S)^. 
We consider an online approach where input packets arrive 
continuously. Further, our initial system model has normalized 
slotted time where parallel transmission channels are assumed 
and thus node S2 operates in full-duplex mode. Therefore, 
at most one packet can be transmitted from Si to S2 and at 
most one from S2 to R per slot, where pi and P2 are the 
corresponding erasure probabilities on the links between Si 
and S2 and 52 and R, respectively. Thus, in order to ensure 
stability for the queues we assume that Ai <l—pi for Si and 
A1+A2 < 1— P2 for 5*2. Each source node performs inter-session 
random linear network coding, where at S2 all incoming flows 
are linearly combined. We also assume that each node in the 
network has full system knowledge provided by a genie. 

As in previous works (see, e.g., |j6l, ||8|, ||9l) we model 
the system as a Markov process. A state S = (11,12) is 
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Fig. 1: System setup. 



defined by ii (or 12) which denotes the number of degrees 
of freedom (dof) at Si (or ^2) that have not been seen at 
52 (or R). The state variable represents the number of 
(coded) packets in the queue Sj^ because all remaining packets 
can discarded from the queue |13|. We define a^^^^ X2)^^} 
the probability of packets being generated at in b time 
slots, k = 1,2. Given independence we obtain a^^^ X2)^^} ~ 

^here a»^{6} = Further, let 

'^{yi i/2)|'S{''l' ''2} be the probability of y/^ packets being trans- 
mitted successfully from 5";. conditioned on the current state 
S when 6^ coded packets, generated from the packets in 
the queue, are transmitted. Since we have parallel transmission 
channels, d^y^ y^-j^g{bi,b2} = d(j^i)|i{6i}rf(y2)|j{^2}, where 

, iy,)(^~Pk)^'pl'^' ifx>0,y^^O,..,mm{x,b)^l 
' YL=x (m) (1 - pi'"" ifx>0,yk= min(a;, b) 
otherwise. 

Herein, x denotes the number of state transitions to reach the 
zero state. 

Let us further define P{T\S) = Ps^S' transition 
probability between states S = {ii,i2) ^nd S' = {i'i,i'2)- This 
effect is captured by the probability of the random vector T = 
(Ai, A2), where — i'j^ — ij^. Thus, the transition probability 
between states S = (11,12) ^"d S' = {i'i,i'2) can be written as 

P(Al,A2l5) = 

"(Ai,A2-/(|/i,?^2)){l} ^(2/i,|/2)|5{l' 1} 

?/ie{o,i},y2e{o,i} 
where 

fO if t/2 = 0,yi = 0, or if 1/2 = 1,2/1 = 1, 
/(yi.2/2) = S -1 ify2 = l>yi=0, 
[1 if 1/2 = 0,yi = 1. 

After some intermediate steps, P(Ai, A2I5) can be written as 
P(Ai, A2I5) = rf(o)|ii{l} «(A0{1} l{Ai>0}- 
ho)|i2{l}"(A2){l}l{A2>0} + 
'^(l)|i2{l}«(A2+l){l}l{A2>-l}] + 
rf(l)|n{l}«(i\+l){l}l{Ai>-l}- 

Ko)|i2{l>"(S2-l)^^^^{A2>l} + 

'^(1)K2{1}«(S2){1}1{A2>0}] (1) 

where Ij^g^j. denotes the indicator function being one when 
s £ S and zero otherwise. 



A. Probability Generating Function 

In the following, we consider the probability generating 
function (PGF) for the state transition probabilities P{T\S). 
The PGF is useful for computing the steady-state distribution 
of the underlying Markov process as discussed below. The 
PGF for a random vector X — {xi,x2, ■ ■ ■ , xn} is defined as 

K i 

where Z = {zi,z2, ■ ■ ■ , zn} and K = {ki, fc2, ■ • ■ , kn}- Clearly, 
^...^Mx{Z)\ 

dzl^ dzt Ui=o,...,^„=o 

^ P{xi ^ ki, . . . ,Xn = kn), (3) 

which simplifies the computation of the individual transition 
probabilities in our approach. For our system we define 
Mrp^g{Z) as the PGF for the state transition probability when 
starting in state S. We have the following lemma. 

Lemma 1. Let P{T\S) = P^^^i be the transition probability 
between S — (11,12) and S' = {1-1,12), where T — {i'^ — 
il, 12—^2)- The PGF for the genie-aided case with inter-session 
coding is given as 

M^|5(z) = e^i(^i-^)e^2(^2-l). 

+ d^l)\i^{l}z2Zi^) . 

The proof is omitted due to space constraints. 

Positive recurrence of the Markov chain can be shown by 
using the criteria in [14], which guarantees existence of a 
unique stationary probability. Let us then define ttj-,^ as the 
stationary probability of state (m,l). Using the fact that 

'^(m,l) = 5Z ^(m',F)-P(m',F)-5-(m,0 W 
m'>0,l'>0 

the PGF for '•^(jnl) be written as 11(21,22) = 

Em>0,/>0'r(m,O^T|(m,o(^)- '^i^^" ^^'^^ node can pro- 
cess at most one packet per time slot, the PGF has only four 
cases of interest: three of them correspond to one or both 
queues being empty, and the fourth corresponds to the scenario 
in which both queues have at least one packet. The latter 
translates into Mjij^]^ i){Z) = '^^r|(afe)(-^) for a > l,b > 1. 
We exploit this fact to express the 11(21, 22) as 

n(21,22)(M-r|(i_l)(^)-2l22) = 

""{91,92)4^ 4^ - ^1^2'r(o,o)^-^r|(0,0)(^) + 

31+92<1 

21^2 J2 '^{gi,0)^^T|(l,0)(^)+^1^2 Yl '^{0,92)^'h\{0,l)(^)- 
9i>l 32>1 

This provides an expression for 11(21,22) in terms of its 
coefficients tt^q o),'''"(o l)'''^(l 0)'''"(l 1)- Searching for the roots 
of i)iZ) — Z1Z2 allows us to find linear equations in 

terms of the unknown coefficients by evaluating the above 
expression with the obtained roots. Further, from Q we obtain 



directly that 7r(oo) = tv^^q o)P(0,Ol(0,0)) + 7r(o i)P(0,-ll(0, 1)) 
and 7r(i^o) = '^(i^o)P(0,Oi(l,0)) + ^(o,i)P(l, -11(0, 1)) + 
7r(o^O)-P(l'0|(0.0)) + 7r(i^^)P(0, -1|(1,1)), which can be used 
to determine enough linear equations to solve for the unknown 
variables n^Q^f^yn^Q^^^^yn^^^^^yn^^-^^^y 

B. Delay 

Let us define -D^ as the time that a packet in experiences 
between being received and being seen at the next hop, and 
thus discarded from the queue of 5*;^.. By Little's Law we obtain 



ElDi] = 



E[D2] 



E[i2] _ T,l>oK^m>0'^{m,l)) 



(5) 



(6) 



A2 + A1 (A1+A2) 

Note that a packet from flow 1 will experience an average 
delay of E[Di] + E[D2] before been see at the end receiver R, 
while a packet from flow 2 will experience an average delay 
of E[D2] before being seen at R. 

C. Energy 

We study the average total energy invested per successfully 
transmitted packet for each of the two transmitting nodes. Si 
and 82- We consider Ef. to be the overall energy to convey 
a packet over a time slot Sf^ (including transmission and 
reception energy). Each source is considered to operate in 
cycles, where each cycle has two phases. First, we have an 
"idle" phase where the queue for Sj. is empty, which requires 
time slots. Second, there is a "busy" phase where the queue 
is not-empty, which requires time slots. This constitutes the 
time the system needs to obtain = for the first time, given 
that the system starts at > after the reception of packets 
at the end of the previous idle phase. 

Theorem 2. The average overall energy per transmitted 
packet at node Sj^, £}., for the genie-aided case with inter- 
session coding is given by 

El o ^ E2 



= (1 -Pem) T-^, £-2 = (X- Pern) 



(A1 + A2)' 



where 

e\tI\ = 



and Pern = 



1 - e-^i 
E[T° 



E[T^] = 



1 - e-^i {Pern + Pl(l - Pern)) ' 



E[T{\+E[TOy 

Proof: We present the proof for £1 . The case of £2 follows 
naturally. For the genie-aided case, at most one packet can be 
in the server at any time. When the system is empty, the source 
will not transmit and no energy is invested in this process. The 
PASTA-property |15| implies that the probability Pem that a 
packet arrives at an empty system is given by the probability 
that the system is empty at an arbitrary time. Using a standard 
argument from renewal theory, the probability of a system 
being empty is given by the mean idle time divided by the 

mean cycle time, i.e., Pem = ^j^^^^^^^oj . Then, the mean 

energy per time slot is given by i?i(l — Pem)- Dividing this 
by the arrival rate per time slot A^ yields the energy invested 



for transmissions from Si. Since all incoming packets of the 
first source are due to Poisson arrivals, E[Ti] — 1/(1 — e~^i). 
For computing E[T2] it is necessary to consider two sources of 
incoming packets: the ones which are locally generated and the 
ones which are received from upstream in the network. Using 
Pem, it is cleai- that E[T^] = 1/(1 -e"^! (Pem -Hpi(l- Pem))). 
The rest of the proof follows naturally. ■ 

III. Genie- Aided Intra-Session Coding 
In this case we separate both flows by performing random 
linear coding only within a single flow. Thus, the state repre- 
sentation from Section |ll] needs to be extended by another 
state variable 13. In particular, the new state is defined as 
C = (11,221^3)' where ii represents the dof present at Si that 
have not been seen at 52 from flow 1, 12 represents the dof 
present at S2 that have not been seen at R from flow 1, and 
13 represents the dof present at 52 that have not been seen at 
R from flow 2. Since we can only service one packet per time 
slot and since 52 must hence choose one flow for servicing at 
each time slot, let us first describe the transition probability 
conditioned on the flow that has been chosen for service. This 
allows to model different scheduling or resource allocation 
mechanisms which are implemented at node S2 in order to 
serve both flows. 

The probability of transition from state C to state C' is given 
as V{T\C). We define the event as the event of flow i 
being serviced during the current time slot by node 52. Define 
= i'j. — ik- First, let us consider the case in which we 
condition on flow 1 being serviced, i.e.. 



p(ri£,yii) = ag^^{i}[p(ri5)U,=o] 



(7) 



where P(T\S)\x^—q is the state transition probability defined 
in ([T]) and evaluated for the case of A2 = 0. If we condition 
V{T\C) on event A2 we obtain 

P(r|£, A2) = (rf(l)|i3{im + i){l}l{A3 + l>0} + 
,(2) 



(8) 



o'(0)|i3{l}"(A3){^}^{A3>0} 
('^(l)|n{l}«(i\+l){l}l{Ai+l>0}l{A2=l} + 
'^(0)|n{l}«(Ai){l}l{Ai>0}l{A2=0} 



Note that if node ^2 implements a policy for choosing the 
serviced flow in terms of the state, either Ai or A2 will happen 
depending on £. If the system uses a randomized policy, 
e.g., if it chooses event Ai with scheduling probability Ps 
regardless of the starting state £, then the overall transition 
probability wifl be obtained as r{T\C) = PsV{T\C, Ai) + (1 - 
Ps)r{T\C,A2). 

Let us define as the time that a packet in 5*^ from flow h 
experiences between being received and being seen at the next 
hop, and thus discarded from the queue of Sj^. We can define 
the expected delay analogous to Section II-B for the intra- 
session case. Note that we may devise the policy for servicing 
flow 1 and flow 2 in such a way that E[dI] + E[dI] ^ E[dI], 
thus providing delay fairness to both flows. 

Likewise, similar considerations as in Section |II-C| for the 
overall transmission energy also apply in the inter-session case. 



IV. Half-Duplex Inter-Session Case 

We now introduce a half-duplex constraint on the problem 
in the sense that node S2 can only transmit or receive packets, 
but not both, in a single time slot. We also assume that each 
node has only access to local information and that ACK 
packets are employed to update the knowledge about the 
state of other nodes in the network. ACK packets introduce 
additional delay and energy consumption. We further assume 
that Si receives acknowledgments piggybacked in the header 
of the transmission packets from intended to be sent from S2 
to R. 

Let us consider the state (11,12, St), where ii and 12 
represent the dof missing at node S2 and R, resp., and St 
indicates the node that will be actively transmitting in the 
upcoming round. We consider that node Si can transmit A'^j^^ 
coded packets in its turn, and that S2 can transmit A^'^-j^ j^-^ 
coded packets when it has the opportunity to transmit. We 
also define a sliding coding window with a maximum number 
of packets Wj. that are part of a random linear combination 
for each node S^. Then, the transition probability (ii,i2,'S'i) 
to state 12,82) can be derived as 

P(Ai,A2|(ii,i2,5'i)) = ci{Ai+m){N,Ja{A2-m){N,J- 
m=0 

l{A2-m>0}l{Ai+m>0}'^(m)|ii {^ii }■ (9) 

Lemma 3. Let P(Ai, A2|(ji, i2i ■S'l)) denote the transition 
probability between the states {ii,i2^Si) and (i'i,i2,S2). The 
PGF is given as 



(A: 



,A2)|(n,i2,5i) 
ii-l 

E 

m=0 



iZ) 



„Ai7V,^(^i--l) A2Af,i(^2-l). 



E 

m=ii 



1 -Pl 
Pi 



m 



Pl H 



-Pl 
Pl 



■m m . 
Z2 + 



Pl ^^1 



The proof is similar to that of Lemma [T] and is also 
omitted due to space constraints. A similar approach can be 
followed for the case of transition from state {11,12,82) to 
state (4,^2, Si). Finally, we define r^^i'^^'-S't) as the time 
associated to a transition starting at state {11,12, St). As stated 



in Section II-A for the genie-aided case we can use the PGF 
in the same way to derive expressions for both expected delay 
and expected energy consumption. 

V. Half-Duplex Inter-Session Coding: 
Batch-by-Batch 

Finding the optimal N^^ and N^^^ j^) for the online case 
discussed in the previous section requires an integer search 
due to dynamic nature of the online approach. This motivates 
considering a batch-by-batch approach where the fact that the 
Markov chain has an absorbing state significantly simplifies 
the complexity of the optimization problem, as we will de- 
scribe in the following. 

For this case, we model the service process as an absorbing 
Markov chain with transition probabilities similar to those 
defined in (|9]l using Ai = A2 = 0. As in the online case. 



we consider that there is a coding window with a maximum 
size for each node S^. The starting state of the Markov 
chain is given by the number of packets in the queue that are 
passed to the server, which is limited by the coding window's 
maximum size. The absorbing state is constituted by states 



(0,0, Si) and (0,0, S2) in Section IV 



We exploit the periodic structure, introduced by the round 
robin assignment of the transmission in our half-duplex 
scheme, to estimate N^^ and A^^j^ Let us define T^j^ g^-^ 
as the mean completion time when the system starts in state 
(il,i2,S(). Note that 



T, 



(ii,i2,Si) 



T, 



{11,12,82) 



n(ii,i2,Si) 



■n(n,«2,S'2) 



+ E^(n 



(n,i2,5l)^(i'l,i2,S'2)^(ii,j2,S2)' 



+ Enn 



(10) 



i2,52)^(n4,Si)^(n,i^,Si)- 
(11) 



We can substitute ( fTT) into ( [TO] i to obtain 

+ '^T{i'i,^'2,Sl)P(il,i2,Sl)^ii[,i2,S2)P(i[,i2,S2)^ii{,i'2,Si)- (12) 



This expression captures the fact that node Si can view 
its communication channel as a transmission link, which has 
a random waiting time between rounds of transmission. The 
waiting time depends on the transmissions of node S2. We 
exploit this fact to propose a search algorithm for finding 
and Ni^^_^ ^^y A similar expression can be found for 
"^(«i «2 >S2) ^ substituting ( [TOj i into ([TT}, and 

similar expressions hold for the analysis of mean energy with 
small modifications. For our case, t^*^'*^''^!) = N^^ and 
rp{ii,i2,S2) ^ Af(j^ j^) + 1- The latter needs to account for a 
time slot used for transmitting an ACK from 7? to S2. 

Let us define Ni^{n) (or ^(i-^ i2){^)) the estimate 
for A'jj (or A'^^^ at step n of the algorithm, and 

P{^l,i2,Sl)^{^' t2,S2)(^) ™d Pi^„J2,Sl)M^u^'2,St)(^^ ^re the 

transition probabilities based on the estimates for the n-th 
step. Finally, we start the algorithm by setting A'jj(O) = ii, 
^iii,i2)(0) = i2,n = l. 

Algorithm 1. SI: TRANSMISSION FROM Si to S2 ; 

Compute iVjj^(n),Vzi = l,...,Mi to minimize the comple- 
tion time of a half-duplex link, as in 111 IV . using the waiting 

time Eii(%,M2)(") + l)^(n,M2,5i)^(i;,M2,52)' '^^^''^ c^'"" 
responds to the second term on the right hand side of ( |12[ ). 

S2: TRANSMISSION FROM S2 to R: 
FOR i'l = 1,2, ...,Mi 

Compute N^j^/ ^^^(w), Vi2 ~ 1, • • • , M2 to minimize the com- 
pletion time of a half-duplex link, as in MIV . using the waiting 
time A'(i;,i'2)('i)%,i2,Si)^(i;,i'2,5i)(")- 
STOPPING CRITERIA: 

%i,i2)H = %i,i2)("- 1)' ^^'i'*- ^T^P 
ELSE n n + 1, and go to SI. 

We point out that this search algorithm can be used for both 
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Fig. 2: Delay vs arrival rate Ai for genie-aided inter- and intra- 
session coding. Parameters: A2 = 0.25, pi = 0.3, P2 = 0.4. 
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Fig. 3: Completion energy in batch-by-batch inter-session 
coding versus erasure probability. Parameters: P2 = 0.4, 
Ml = M2 = 3 packets, Ei = 1, E2 = 2. 

completion time (as shown above) or with different metrics, 
such as energy or the product of energy and delay to reach a 
trade-off between both metrics. 

VI. Numerical Results 

Fig. |2] compares genie-aided inter- and intra-session coding 
by illustrating the delay performance for flows 1 and 2, i.e., 
E[Di] and E[D2] in ^ and (|6]l. For the intra-session case we 
use a randomized policy at S2, which sends packets from flow 
1 with probability Ps and services flow 2 otherwise. For the 
case of intra-session coding with Ps = 0.75, we observe that 
the delay for flow 1 and flow 2 have the same mean delay 
performance at = 0.12. As can be seen from Fig. [2] the 
choice of Ps to achieve E[Di] « E[D2] depends on the arrival 
rate. However, this illustrates that the combination of intra- 
session coding and random scheduling policies at intermediate 
nodes in a line network can be used successfully to provide 
delay fairness for sources at different number of hops to the 
final receiver. 

Fig. |3] compares the energy performance for batch-by-batch 
inter-session coding optimized by using Algorithm 1 for differ- 
ent metrics and for an uncoded selective repeat (ARQ) strategy. 
Clearly, the completion energy is higher when we optimize 
for completion time ("Opt. Time") than optimizing for energy 



("Opt. Energy"). If we use a metric that aims to reduce the 
product of mean energy and and mean time simultaneously 
("Trade-off Energy-Time"), it yields an intermediate behavior 
between the two. The genie case with no half-duplex constraint 
constitutes a lower bound on energy consumption, because i) 
it does not require ACK packets, and ii) it sends only enough 
to complete the transmission. 

VII. Conclusions 
We have considered a two-hop erasure line network where 
as an extension of existing work each of the first two 
nodes intents to send local information packets with Poisson- 
distributed arrivals to the receiver node via random linear 
network coding. For both online and batch-to-batch schemes 
a queueing-theoretic framework based on Markov chains and 
the corresponding moment-generating functions for the state 
transition probabilities has been provided. We found that 
despite intra-session random linear coding is not throughput 
optimal, we can achieve delay fairness for flows coming from 
different sources by employing a random servicing policy at 
the middle node in the line network. Then, the half-duplex 
case is addressed, and it is shown that there is an optimum 
number of packets each node needs to send before stopping 
to wait for the receiving nodes to acknowledge the missing 
degrees of freedom. 
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